Papers with Conformal prediction
Non-Exchangeable Conformal Language Generation with Nearest Neighbors (2024.findings-eacl)
Copied to clipboard
| Challenge: | Existing methods to evaluate reliability of generated text are lacking in natural language generation. |
| Approach: | They propose a non-exchangeable conformal prediction method that provides bounds on coverage . they validated their method with k-NN retrieval and show that it produces encouraging results . |
| Outcome: | The proposed method produces encouraging results in machine translation and language modeling tasks. |
Quantifying and Understanding Uncertainty in Large Reasoning Models (2026.acl-long)
Copied to clipboard
| Challenge: | Existing methods for estimating generation uncertainty do not provide finite-sample guarantees for reasoning-answer generation. |
| Approach: | They propose a method that provides the uncertainty of the reasoning-answer structure with statistical guarantees. |
| Outcome: | The proposed method disentangles reasoning quality from answer correctness while establishing theoretical guarantees for efficient explanation methods. |